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Abstract 

We consider Abelian M5 brane on a six-manifold which we take as a circle bundle 
over a five- manifold M. We compute the zero mode part of the M5 brane partition 
function using Chern-Simons theory and Hamiltonian formulation respectively and find 
an agreement. We also show that the D4 brane on M shares exactly the same zero 
mode partition function again using the Hamiltonian formulation. For the oscillator 
modes we find that KK modes associated with the circle compactification are missing 
from the D4 brane. By making an infinitesimal noncommutative deformation we 
have instanton threshold bound states. We explicitly compute the instanton partition 
function up to instanton charge three, and show a perfect match with a corresponding 
contribution inside the M5 brane partition function, thus providing a very strong 
supporting evidence that D4 brane is identical with M5 brane which extends beyond 
the BPS sector. We comment on the modular properties of the M5 brane partition 
function when compactified on T 2 times a four-manifold. We briefly discuss a case of 
a singular fibration. 
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1 Introduction 



On the M5 brane worldvolume W there lives a selfdual two-form B, whose field 
strength H — dB is selfdual. There is no covariant action one can write down 
for a selfdual two- form (without including auxiliary fields) because H A H = 0. 
If one computes the partition function of a non-selfdual two-form, one finds for 
the zero mode part a sum of terms 

z zero = 5>£](T)egJF) 

a. b 

Here r is the period matrix on the intermediate Jacobian 

J w = H 3 (W,R)/H 3 (W 7 Z) 

and a\ b{ are characteristics each of them taking values or |, and i = 1, • • • , ^ 
where &3 = dimH 3 (W, K). [£] (t) denotes the Jacobi theta function, and one 
of these theta functions will correspond to the partition function of a selfdual 
two-form on W embedded in some eleven- manifold. In general it appears the 
M5 brane partition function is not completely diffcomorphism invariant. To 
see this, let us take the worldvolume as W = T 2 x TN [1]. We have precisely 
one selfdual harmonic two-form on TN and the theory of selfdual two-form 
reduces to the theory of a compact chiral scalar field on T 2 . It is well-known 
that no modular invariant partition function exists for a compact chiral scalar 
on T 2 . What we can require is the M5 brane partition function be invariant 
only under diffcomorphisms that preserve the physical data which determine 
its characteristics. Such physical data may consist of the orientation of W 
and the spin structure of W [1]. How the spin structure dependence on the 
characteristics appears is complicated and we will not address the question in 
any satisfactory way. It appears that the framework where this question can be 
answered is within seven-dimensional Chcrn-Simons theory. In the first part of 
this paper we follow [1] to compute the partition function of a selfdual two-form 
on a generic six-manifold from Chern-Simons theory, but leave the determination 
of the characteristics aside perhaps for the future. 

We next perform a direct computation of the M5 brane partition function 
starting from the M5 brane action. Previous works on direct computations 
include [2], [3], [4]. The separation of the partition function into a zero mode 
part and an oscillator mode part is somewhat intricate. We can illustrate this 
by taking a real compact 2d scalar on T 2 . Its full modular invariant partition 
function is given by 

V- 6[g](r) 2 



Here t](t) denotes the Dedekind eta function. If we use the Hamiltonian for- 
mulation, then we are led to the following separation of this partition function 
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into zero mode and oscillator mode parts, [5] 

E l e El Ml 2 

a, 6 

1 

neither of which are modular invariant by themselves, and only the product 
of these is modular invariant. If on the other hand we use the Lagrangian 
formulation, then it is not so obvious how we shall define the measure in the 
path integral. One way is to define the measure is so that we end up with the 
following separation [6] 

T 2 £|ee] (r)| 2 

a, b 

l 

t 2 \v(t)\ 2 

again neither of which are modular invariant by themselves 3 . 

One of our goals in this paper is to establish an equivalence between M5 
brane partition function on a circle-bundle over some five- manifold M5, and a 
corresponding partition function for D4 brane on M5 obtained by dimensional 
reduction along the fiber. To this end we need to preserve the separation between 
zero modes and oscillator modes in our comparison between M5 and D4 brane. 
This means that we can not work in the Lagrangian formulation to obtain the 
zero mode contribution of the D4 brane partition function as was done recently 
in [7], [8], and try to match this zero mode contribution with the zero mode 
contribution of the M5 brane when that is computed using the Hamiltonian 
formulation. In fact a mismatch is shown explicitly to arise between zero modes 
for D4 and M5 brane by using this approach in [8] . But this mismatch is entirely 
due to the fact that different formulations arc used to compute zero modes. By 
using the Hamiltonian formulation for both M5 and D4 brane, we will see that 
their zero mode contributions respectively perfectly agree. 

As we already indicated above, a careful treatment of zero mode and os- 
cillator mode contributions is also crucial for modular invariance. In [2] it 
was shown that for the sclfdual tensor held part of M5 brane on T 6 this gives 
rise to an SX(6, Z) modular invariant partition function for the choice of 00- 
characteristics. For this we need to combine zero-mode and oscillator-mode 
contributions. In this paper we also show that the scalar helds part alone is 
SL(6, Z) invariant by combining zero mode and oscillator mode contributions. 
For generic six manifolds on the form T 2 x M4 we study SL(2, Z) mapping class 
group acting on the T 2 . Here we show that the M5 brane partition function 
with 00-characteristic is modular invariant up to a phase. 

Considering now the oscillator modes of D4 on M5, we find that all KK- 
modes along the circle direction are missing. Thus, at this stage, we find a 

3 A modular invariant combination is \Zt2\t)( t )\ 2 
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mismatch of the partition functions in their oscillator parts. But of course this 
is not the end of the story. Taking S 1 as an M-theory circle direction, a KK 
momentum along the circle direction is interpreted as a DO brane in the type 
IIA string theory side. When DO branes are bound to D4, their dynamics can 
be faithfully described by world volume degrees of freedom on the D4 brane. 
These are nothing but instantonic particles which satisfy the (anti) selfdual 
equation along the four spatial directions of D4. For our U (1) case, however, the 
corresponding instanton solutions become singular and, consequently, missed 
when one considers only regular configurations. In order to regularize them, 
we introduce a spatial noncommutativity which makes the size of instanton 
finite and, then, take the commutative limit in the end recovering the original 
symmetries of D4 brane. 

One may wonder whether the DO brane could escape the D4 brane when it 
becomes singular in the commutative limit. However in [9] it was argued that 
the Higgs and Coulomb branches are decoupled even when the instanton shrinks 
to zero size. This argument was further supported by an index calculation made 
in [10] for instanton number one. 4 

In this paper we show that these small instanton contributions match pre- 
cisely with those of the missing KK modes, which is in accordance with the 
original idea of the proposal in [11, 12]. In particular one can be rather explicit 
for the one-instanton case. For two instantons, in addition to the Hilbert space 
of two separate instantons, one can find so-called threshold bound state in their 
moduli space which corresponds to a single p 5 = 2 KK mode of the M5 side 
[13]. This counting can be continued to higher instanton numbers [14]. 

Finally we discuss the case of singular fibration in which the circle size R 
becomes zero at some points of base manifold [15]. For this, in addition to 
the usual 5d sYM fields on D4 worldvolume, one may need some extra degrees 
localized at the singular points in order to have a full agreement. We illustrate 
this phenomenon rather explicitly in the example of TN x T 2 where one has 
a codimension-four singularity if one takes the M-theory circle direction to be 
that of the Taub-NUT circle. We show that the extra degree needed is a chiral 
2d scalar on T 2 . 

Other works which are of some relevance to various aspects of our work 
include [16], [17]. 

In Appendix A, we obtain the period matrix for six-manifolds W which are 
such types of circle-bundles in which the fiber-circle constitutes a one-cycle in 
W. So for instance this excludes the case of W — S 3 x S 3 . Even though S 3 is a 
circle-bundle there is no one-cycle in S 3 . In Appendix B we obtain the period 
matrix for W = T 2 x M4 where for simplicity we assume there are no one-cycles 
on M4. In Appendix C we present holomorphic factorization of the partition 
function of a nonchiral boson (applicable to 2d scalar and 6d two-form) at the 
free fermion radius. 

4 We would like to thank Sethi for pointing out this problem to us, as well as informing us 
about his reference. 
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2 M5 brane from C hern- Simons theory 



We follow [1] and consider the action of a non-chiral two-form B such that only 
its selfdual part couples to a background three-form gauge potential C whose 
field strength is G = dC, 



Here A is a coupling constant, W denotes the six-dimensional world-volume of 
the M5 brane, \H\ 2 = H A *H where we define H = dB + C. Our definition of 
Hodge dual is found in appendix A. This action is the six-dimensional analog of 
a gauged WZW action on a two-manifold to which there are many similarities. 
The action is not invariant under the gauge symmetry SC — dA, SB = —A but 
it transforms as 



As shown in [1] this gauge anomaly is canceled by the term ~ / C A G A G in the 
M-theory effective action. For our purpose, the gauge anomaly will be helpful 
in order to match with Chcrn-Simons theory in seven dimensions, so for the 
moment we like to keep it, rather than canceling it. From the action, we derive 
the equation of motion d * H = G. We also have the Bianchi identity dH = G. 
On W we may decompose any three-form u as uj = uj + + w~ where *lu + = 
±u> . The equation of motion and the Bianchi identity are consistent with the 
sclfduality equation H~ = and it is in this sense that the action describes 
a selfdual three- form H + . Classically this sclfduality equation is consistent for 
any value of A. But as we will see, the situation changes in the quantum theory. 
If we introduce the inner product (uj,rj) = J w uj A *r/ then we can write the M5 
brane action in the form 



S[B,C] 




(2.1) 



SS[B,C] 




S[B,C] 



- ((dB, dB) + 2(C+,C-) + 4(dB, C~)) 



Let us define the partition function of B in the background of C as 




By differentiating under the integral sign, we then find that 








and 
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In the second relation we assume the equation of motion dH + = G and we 
define a covariant derivatives as 



5 -ac+ 



DC- 5C 
D s 
~DC+ = 5C~ + lXC ~ 

Our functional derivatives are defined with respect to the inner product as 
M 



Let us now consider Chern-Simons theory at level fcona seven-manifold U 
bounded by W 



S = — [ CAdC 
4?r Ju 



As usual we can make a variation and read off the symplectic potential from 
the boundary term. If we assume that dU = W, then we have the symplectic 
potential 

A = -— f CA8C (2.2) 
4tt J w 

which we can also write as 

A = ±-(-(C-,6C+) + (C+,6C-)) 

Here we have noted that the inner product of two selfdual or two antiselfdual 
three-forms vanish identically. Its curvature is the symplectic two-form 

= —(6C+,6C-) 
2tt ; 



In components we have 



and the inverse is 



2tt 



We define covariant derivatives 

D S 



k 



- iA 



DC± <5C± 
where 

A c± = T ^CT 
Air 
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consistent with 

Gauge transformations act on a wave function ip(C) and the gauge potential 

«5A 
3c 3 



as ip — > e lA ip, A c ± — > A c ± + 4^. Under a gauge variation SC = dA the 



Chern-Simons action vary by 

SS = A / A A G 

This variation is identical with the gauge variation of the M5 brane action if we 
choose the coupling constant as A = j^. 

We impose holomorphic polarization of the wave function ip, 

" ip = 



DC+ 



In temporal gauge we have the Gauss law constraint d(C + + C~) = 0. After 
quantization this becomes d (P(C + ) + P{C~)) ip — where the prequantum 
operators are given by 



The general solution to the holomorphic polarization condition is on the form 

' ik 
M 

and so 



iP(C+,C~) = exp(^(C+,C-))<A(C-) 



P(C+) = -^D_+C + 
P{C~) = c~ 

From this we get the quantum version (2.3) of Gauss law as 

d i^ + £; G )* - < 2 - 3 > 

We see the same equations from the M5 brane action if we choose the coupling 
A = j-. This implies that we shall identify the wave function ip with the M5 
brane partition function Z. 

2.1 Zero mode part 

Let us now compute the zero mode part of the wave function ip. We expand the 
harmonic part of C in a basis of harmonic three-forms on W. We can choose this 
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as a symplectic basis. If we let a, and b % denote three-cycles in W, then ctij and 
ft 1 which denote the Poincare dual harmonic three-forms which we normalize as 

1 

2^ 



= Si 

will constitute a symplectic basis on W in the sense that 



2tt J b3 



Iw a i A a l Iw a * A ft \ - 4^2 ( 5\ 

We will also define the following linear combinations 

by demanding these are selfdual and antiselfdual harmonic three-forms respec- 
tively. The period matrix can then be extracted by integrating u>i over the 
^-cycles, 



2ttX 



t = — n - t 2 

f = -Tl + T 2 



If we define 



then we have 

/ WjAWj = 87r 2 (T 2 )ij 
Jw 

We expand the harmonic part of the C-field as 

C = x'eti + yiF 
In terms of complex coordinates that we define as 

CLi — T~ijX^ Hi 

di — TijX^ Hi 

we have 

C = ^(T 2 y j (anjj - diujj) 

Large gauge transformations leave the holonomy 

H(C) = e^c c 
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invariant for any choice of three-cycle C. Since the connection is constrained to 
be flat by the Chcrn-Simons action, the exponent defines an element in J\y which 
is a torus T* 3 ^ whose coordinates are (x l ,yj) subject to torus identifications 



V3 ~ Vj + 1 
Large gauge variations act on J\y as 



8x l = n l 

5 Vj = m (2.4) 
for integers ri l ,mj. The Chern-Simons Lagrangian becomes 

L = -y( T 2) y (-o»fflj + ai&j) 
and we get the symplectic potential and symplectic two-form as 



kir , 
T 

Q = -kir{T 2 ) l3 8ai/\5a 3 (2.6) 



A = —{T 2 ) ij {-aMj + aiSaj) (2.5) 



Canonical commutation relations are 



and prequantum operators are 



^(r 2 ), (2.7) 



1 



1 



which one may check realize the algebra (2.7). 

Large gauge transformations act on the potential and the wave function as 

A 1 = A + 5A(n,m) 



where we define 



A 1 (a, a) = A(a + rn — m,a + rn — m) 
rp'(a,a) — ip(a + fn — m,a + rn — m) 



°While a non-Abelian generalization of the M5 brane Lagrangian has not been found, one 
can probably more easily write down a non-Abelian generalization of the reduced Chern- 
Simons quantum mechanics Lagrangian on the space of zero modes (the intermediate Jaco- 
bian). Here on the intermediate Jacobian wc have just complex-valued scalar fields a{ which 
depend only on time. 
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For the sake of convenience (and not for pedagogical reasons), we will switch 
back and forth between real and complex coordinates. As we want to see how 
various quantities depend on the various choices we make, we will now assume 
the symplectic potential is chosen as 

A = 2nkx 1 5y i + 5fi(x\yj) 

with an arbitrary function [i. Such a gauge transformation of the symplectic 
potential corresponds to a canonical transformation of the phase space variables 
x l ,yj. We impose holomorphic polarization on the wave function 

D ai ip(a,a) = 

This condition is solved by 

ip(a,a) = e ^ K ^+^ a ^U(a) 

where 

K = irkTijX l x J + f{a) 

is the Kahler potential. In the Kahler potential we have the freedom of adding 
an arbitrary antiholomorphic function /. 

We can read off the gauge parameter associated to a large gauge transfor- 
mation (2.4) from the variation of the symplectic potential 

5 A = A(x + n,y + m) — A(x, y) = 5A(n, m) 

This gives us the gauge parameter as 

A(n,m) = 2irkn l yi + /i(x + n,y + m) — /i(x, y) + c(n, m) 

where c(n, m) is a further closed term that we can always add. From 

e iA{n > m) ip(x,y) = i;(x + n,y + m) 

we find that fx cancels out and we are left with the condition that 

^ikn'y^icin^^K^a)^ = e iK(a+6a,a+5a) ^ + §a) 

Here 

K(a + 5a, a + 6a) — K(a, a) — KkTijrtw? + 2-Kkrijn 1 x^ + f(a + 5a) — f(a) 
and so we have, by noting that 

n % (yt - njXp) = en 

that 

<P(a + Sa) = e *c(n, m ) e f(a+Sa)-f(a) e -r*kn J n>ni+2TTrkn*a t( j ) ^ 
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Here 

Sai = Tijn 3 — mi 

and c(n, m) can be partially fixed by requiring that <f>(a) satisfies the 'cocycle 
condition' of large gauge transformations 

(j)(a + r(n + n') — to — to') = 0((a + rn' — m') + rn — m) (2.8) 

Here, on the right-hand side our notation is supposed to mean that we first 
compute the gauge transformation <p(a' + rn — to) in terms of <p(af) and subse- 
quently we express <f>(a!) as a gauge transformation of <f>(a). Let us first consider 
the case /(a) = 0. We then find 

c(n, m) = TtkTijri'm 3 

is the minimal choice that makes the cocycle condition satisfied. But we can 
add further linear terms to this 

c(n, to) = nkTijin l m 3 + 2ir (cjn* + c? l TOj) 

and still satisfy the cocycle condition. If we have no n- vanishing /, we still get the 
same result for c(n, m) due to the exponential nature of e l} ~ which automatically 
makes the cocycle condition satisfied. 

If we choose / = then we can identify the gauge transformation of <f> with 
the gauge transformation of a Jacobi theta function with certain characteristics, 
related to a and d l as 

0(a) = 6 \l J {-kr\ka) 
Let us now consider a three-cycle Cn,m in W characterized by periods 



/ Ui = Mi + TijN j 

J C N.M 



ik f„ 



and define the holonomy 

H(N, M) = e 

over this three-cycle. When we insert the zero mode expansion for C we get 
H(N,M) = e »H( M + TA, )-^)* ,, 'r(«+ffl).^) ,, « ] ) 

Since we do not make any canonical transformation of the phase space variable 
C when we define the holonomy, we shall use the symplectic potential that we 
obtain as the boundary term of the Chern-Simons action, that is (2.5). In this 
gauge we solve the polarization condition by 

ip{a,a) = e-^^ Ja ^(j)(a) 
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where <fi(a) depends holomorphically on a. The gauge variation of ip now induces 
the gauge variation 

4>{a + m - m) = e T i (^) l3 [(™-m) t (rr l ^m) J +2(™-m) l a 3 ] elC (n,m) (?i( --^ ( 2 

As before we can partially fix c(n, m) by demanding that we satisfy the cocycle 
condition (2.8). We then again find that 

c(n, to) = k-Kniin 1 + 2Tr(c t m i + dirt) 

up to some constants c % and di that we have to fix by other means. On the wave 
function <f> the prequantum operators reduce to the quantum operators 

i 

Q{ai) = -^(T^ijdaj 

Q{ai) = di 

which also realize the algebra (2.7). We use the BCH formula 

e A+B = e -^[A,B] e A e B 

to express the holonomy in the form 

H(N,M) = e -^(T 2 y^M+TN) t (M+TN) Je - t Trk(M+fNUT 2 yia Je (M+TN) t d- az 

When we act with the holonomy on <p(a) we then get 

H(N, M)(j){a) = e -^(^)' J (M+^).(M+rJV) 3e --fe(M+riV) I (r 2 )-a^ ( - +M + tN ) 

Finally we use the gauge transformation of <p as given in (2.9) and find that 
most exponential factors cancel out, and we are left with 

H(N,M)^(d) = eM&Mi+di^jkKM^^) 

We now see that the eigenvalue of the holonomy corresponds to the character- 
istics c 1 and di. Using the BCH formula we can show that the holonomies obey 
the algebra 

H(N,M)H(N',M') = e^ k{M ' N ' +lvUN "^H(N + N',M + M') (2.10) 

We can be ignorant about the signs in the exponent since the difference is 
always of the form e 2mkM i N = 1. For k even this formula admits that we take 
all holonomies to be H(N,M) — 1. For k odd this formula forbids us to take 
all H(N, M) — 1 and the best we can do is to allow for some (or all) of them to 
be -1. 

Let us now turn to holonomies on Jw, 

W(N,M) = e f ^^' A 



12 



As a preliminary attempt we define these by choosing the gauge potential as 

A = 2irkx i 5y l + 2m(c i 6y i + d t 5x % ) 

since this makes W(N, M) invariant under (2.4) while any other choice obtained 
by adding for example adding an exact term on the form ^8{x l yi) would not give 
us an invariant holonomy under (2.4) for generic values on £. We will return to 
this issue more fully below. Let us choose a closed loop on Jw as a straight line 

cn,m = {{x i ,y j ) = {N i 6,M j 6)\0<9<l} 
= {a, = (TijN 1 - M^O <9<l} 

The holonomy can now be evaluated to 

W(N,M) = e 27r »( c * M i+< i i JV< ) e ife7rM * Jvi 

and we can read off the characteristics from 

W(e\0) = e W 
W(0, ej ) = e 2 ^ 

where e l = (0, • • • , 1, ■ ■ ■ ,0) with 1 at the i-th entry. However this does not 
bring us any closer to what the characteristics really should be. 

Our definition of the holonomy W(N, M) is not satisfactory since it is gauge 
choice dependent. We also can not see if using the definition of holonomy as 
proposed in [18] can help us here. If we can find a gauge invariant definition of 
W(N, M) we may expect that W(N, M) = H(N, M) for that gauge invariant 
definition since clearly H(N, M) is gauge invariant. Indeed there might exist a 
gauge invariant definition of W(N, M). To allow for the most general possible 
extension of manifold and symplectic two-form, we shall include all the oscillator 
modes and we are led to consider seven-dimensional Chern-Simons theory to 
compute the holonomy following [1]. By including the oscillators, we have to 
consider the symplectic potential on the form A = j- J w C A SC. We then 
consider a one-cycle C in Jw around which we want to compute the holonomy 
for this symplectic potential. Let us parameterize the one-cycle by 9 e [0, 1] 
and consider a one-parameter family of C-fields that we denote as Cc{0). Time 
coordinate is being replaced by 9 coordinate. The differential SC in field space 
becomes a differential in the seven dimensional space S 1 x W where S 1 is the 
one-cycle parametrized by 9. The holonomy can be expressed as 

H{C) = cxp i f A = cxp ^ / Cc A dC c 
Jc ^TT J s i xW 

However this formula is only valid if A is globally defined along C. For the 
generic case we instead define the holonomy by finding an extension X whose 
boundary is dX = S 1 x W and define the holonomy as 

H(0 = e*p£jf GAG! 
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where G — dCc- This is still a simplification of the real situation in M theory 
since in general G is an element in a shifted integral cohomology [1]. Never- 
theless, the point is that we need to find an extension X over which the spin 
structure of S 1 x W and the gauge field Cc can be extended. How one can 
make such an extension may depend on the spin structure on W . For example, 
if we have periodic (Ramond) fermions on a circle we can not extend the circle 
to a disk. This means that the holonomy will depend on the spin structure on 
W. 

One may consider W — T 6 as an example. Here [§] is the only fully 
modular invariant choice. But this need not necessarily be the partition function 
of the M5 brane of a given spin structure if that spin structure is not fully 
modular invariant. The M5 brane partition function need only be invariant 
under modular transformations that preserve the spin structure. 

2.2 Oscillators 

The inner product of two wave functions is defined as 6 



(V>,V>) = J vc^o^o 

= I 2X7+2X7" exp (^(C+.C - )) 

We can expand C = Charmonic + dx m a harmonic and an exact piece since 
by Gauss law dC — 0. We note that \ is rea l m both Euclidean as well as in 
Minkowski signature since Wick rotation can only affect the components Comn 
which in our gauge choice are zero. The fact that x is re &l means that it can be 
gauged away by a gauge transformation 

SC = d\ 

by taking the real gauge parameter as A = — %. This is thus different from 
the quantization of three-dimensional Chcrn-Simons theory [19]. The generator 
of gauge transformations is given by the Gauss law constraint, which we here 
express for an infinitesimal gauge parameter A in the form 

Upon integration by parts, this equation makes sense only if A is such that 
(dX) + = and C + = 0. In that case this equation reduces to 

cP(C-+(dX)-) = <f>{C-) 

whose solution can be taken as 

) harmonic^ 

6 In Euclidean signature we define the b ar as usual complex conjugation. In this signature 
we also have C+ A C~ = -iC + A *C~ and C ± = C ± . The exponent exp ^(C + , C~ ) is now 
real with respect to our complex conjugation in Euclidean signature. 
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with a trivial oscillator contribution. The oscillator mode contribution to the 
inner product of wave functions is now given by 

(V>,V0o SC = JvCS(dC)exp^J\C\ 2 ^ 

where we have noticed that (C + , C~) = |(C, C). We replace 

5{dC) = J ©Xexp(^ JdCAx) 

Completing the square and shifting C — > C + dx an d noting the measure is 
gauge invariant, 2?(C + c/x) = T)C, we get 



{ll>,ll>)o8C = 




The path integral is suffering of a gauge redundancy 6x — dX and so needs to 
be gauge fixed. It is clear that this is path integral is precisely equal to the path 
integral of a non-chiral two-form gauge field on W, but which here has been 
obtained from the Chern-Simons theory on / x W. The path integral was over 
C but this is constrained to be flat dC = 0, and the exact part can therefore 
be re-expressed as an integral over x- We note that the sign gets correct. We 
express the path integral in Minkowski signature, and we have the phase factor 
e lS from which we read off the action 

s = -rj^ 2 

which corresponds to the action (2.1) in a vanishing background C field if we 
make the identifications B = \. 



3 The M5 brane partition function 

In this section we perform a direct and explicit computation of the full Abclian 
M5 brane partition function using Hamiltonian formulation. For the selfdual 
three-form we recover the result we got above from Chern-Simons theory, but 
here we will also supplement this with contributions from the five scalar fields 
and the fermions. 

In order to apply the Hamiltonian formulation we assume that the M5 brane 
worldvolume M 6 is a circle-bundle over a base- manifold M 5 . We choose the 
following parametrization for the metric on Mq 

ds 2 M5 = !3dt 2 + G mn (dx rn -V m dt)(dx n -V n dt) (3.1) 

and we assume that (3 is a constant. We will assume that dt is a Killing vector 
field, which means that d t V m — and d t G mn — 0. We will associate t with time 
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and x m with spatial directions on M5. We will promote /3 to a complex holo- 
morphic parameter, thus allowing for Minkowskian and Euclidian signatures. 
As the M5 brane action we will take 



S — Sb + Set 



'j/> 



where 



Sb = ~J d?x\f—gH MNP H 

s* = -\ jd e x^d M ^ A d. 



MNP 
A 



'I 



SV> = i d b x^ipr M d M ^ 



Sclfduality fixes the coupling constant to be 

Air 



3.1 Scalar field 

Let us consider the scalar field action 



S = -\ I d 6 x^g MN h M h N (3.2) 



2 



M 6 



for one of the five real scalar fields. Here we define the field strength of a zero 
form scalar field <j> as 

fiM = d M 4> 

The momentum conjugate <p is 

7T = 

The Hamiltonian is 

H = I d">x^G{-tih t + h™ D h m ) 

We note the following metric identities 7 

ht = /3h t -V m h m 
h™ D = h m + V" 1 ^ 



7 Let us derive them here: ht = gtth 1 + gtmg mn h n + g tm g mt ht gives ht(l — gtmg mt ) = 
gtth 1 + gtm.g mn h n . We then miraculously notice that g tt , 1 — <?tm<? mt and gtm,g mn all contain 
the common factor /3+V 2 which can be factored out and the identity follows. Next we compute 
h™ = g mt h t + g mn h n = ±V m h t + G mn h n + ±V m V n h n and substitute ht = gtth 1 - V n h n 
and we find that two terms ~ V m V n hn cancel and the second identity follows. 
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and we see that the Hamiltonian can be expressed in terms of the five-dimensional 
metric as 



H = 1^/3 f ^xVG^/Sih 1 ) 2 + h m h m + 2h t V m h m ) 
2 Jm 5 

To get a better handle on the scalar field partition function, and in particular 
its modular invariance, we temporarily introduce a regulator and assume that 
the scalar field is compact 

4>{x) ~ (j){x) + 2nr 

with a radius r that we in the end will take to infinity. The important point 
is that the regulator r does not mix with the geometry of space-time, so we 
can introduce r as a separate quantity on which the partition function may 
depend, in order to extract its dependence on the geometry. Using this together 
periodicity of the scalar field together with the canonical commutation relation 



we conclude that 



is integer quantized as 



[4>{x),n{y)] = iS 5 (x-y) 
-V^ J cPyVGh* 



P 



P = n - 

r 

where n is integer. Moreover, we expand h in a basis of harmonic zero forms. 
But such harmonics are necessarily constants. So h° is a constant. It must 
therefore be given by 

h° = 



V^(Vol)r 

where Vol = j d 5 x\/G. The Hamiltonian is now given by 

2Vol r 2 

where the + • • • terms will be irrelevant in the limit r — > oo. In that limit the 
discrete sum can be replaced by an integral over q — n/r 7 and we get 



Of course the integral is evaluated by taking /? real and positive, and then we 
make the analytic continuation. 
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3.2 Tensor gauge field 

The tensor gauge field can be treated in an analogous way as the compact scalar 
field. The action for the non-chiral tensor gauge field is given by 

S = ~f d e xV—gH MNP H MNP 

We define the field strength of the two- form gauge potential Bmn as 

HmNP = 9mBnP + djyBpM + dpBMN 

The momentum conjugate to Bmn is 

fiMN _ ^ V — fl ^/(JfftMN 

and we have five primary constraints 

E mt = q 

for m = 1, ...,5. These we must supplement by equally many gauge fixing 
constraints. We will choose the temporal gauge 

B mt = 

The Hamiltonian is 



H = 



J d 5 xV~G (SH tmn H tmn + H mn PH mnp ) 



12 

We note the following metric identities 8 

Bo mn (3H ran V p H mn p 
H™p P = j{ mn P _|_ 3y[" l /fl t l™p] 

and we see that the Hamiltonian can be expressed in terms of the five-dimensional 
metric as 



h = bEl 

12 

The holonomies are periodic 



J d 5 xVG {-^H^H'mn + 6V p H tmn H mnp + H mnp H mnp ) 



in in 



B + 2ir 

Let us introduce the covariant momentum variable e mn = whose indices 
we can covariantly lower by the five-dimensional metric to define a momentum 
two-form e = ^e mn dx m A dx n . From the canonical commutation relations 

[B mn (x),E"{y)] = iS^J 5 (x-y) 



s The derivation is analogous to what wc did for the scalar field. 
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wc sec that 



's 5 

Here we denote by f2* the basis elements of harmonic two-forms on M 5 and we 
have a metric 



n 1 A 



If we expand 
then we get 



M 5 



e = e,fT 



where we define e l — G^ej. Then 



2e l = n l 

must be integer quantized momenta conjugate to the 27r-periodic holonomies 
J s B. We also expand -£T = m l Qi where m l are integer quantized magnetic 

charges and Q,i are dual three-forms to SV as defined in Appendix A. By taking 

47T 

we get the zero mode part of the Hamiltonian as 



^nGij [ n i n j + \m l m? 



2ir£ijn l m J 



where Gij denotes the inverse of C/*- 7 ' and is defined in Appedix A. The zero 
mode partition function is defined as 



-2ttiH z 



By identifying the period matrix as 

Tij = 2ir (y—C-ij + \J~-flGij^j 
the zero mode partition function can be written as 9 

Z zero = 2 eg] (-r)6g](-r) 



9 Complex conjugation works as usual only in Euclidean signature where /3 is real and 
positive. But we can extend analytically to arbitrary complex while always prescribing the 
conjugation rule yj—fi = —yj—fi. Using this prescription we can use theta function formalism 
also in Minkowski signature which is the natural signature for Hamiltonian quantization. 
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Here the Jacobi theta functions are given by 

© [b] W = exp M"' + ai ) T ij( nj + 2mn%) 

r>*£Z 

and the characteristics a* and bi are running over 0, ^. 

So far we have computed the zero mode part of the partition function of 
a non-selfdual three-form H, and we have seen that it is holomorphically fac- 
torizable in a certain sense, as a finite sum of products of chiral and antichiral 
parts. On the Chern-Simons theory side, this corresponds to the inner product 
of wave functions. The wave function that corresponds to the partition function 
of selfdual three-form is now given by 

z = eg](-r|0) 

for some certain characteristics. 

This computation shows that we shall choose the corresponding Chern- 
Simons level to be k = 1 but it might be interesting to ask whether other 
values of k can be implemented in M5 brane theory as well. 



3.3 An alternative treatment of selfdual tensor gauge field 

For the tensor gauge field we may use a selfdual Lagrangian. Holomorphic fac- 
torization works nicely for the zero modes if we define the period matrix on the 
space of harmonic three-forms. For the oscillator modes this method requires an 
extension of the period matrix to include the oscillator modes. However this ex- 
tended period matrix would be an infinite-dimensional matrix which could lead 
to additional subtleties in the holomorpic factorization. The alternative route 
is to work directly with a selfdual Lagrangian from which we can compute the 
contribution of the the selfdual oscillator modes using conventional quantization 
methods, that is Hamiltonian quantization or path integral quantization. 

Let us first return to the nonselfdual Lagrangian. For the zero modes we 
have two set of integers, m l and n\ Using notations introduced in Appendix A, 
these integers were defined as 

mn Qmn 

~ 2 * 

Let us now decompose the three-form into selfdual and antiselfdual parts, 

H = H+ + H- 

where 

jj±,tmn ib — ^ ^tmnpqr 

We accordingly decompose the two sets of integers as 

m 1 = m l+ + m l ~ 
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2n l = m l+ - m l 

whose solutions are 



i± i , m 

m l± = n l ± — 



We can express this as saying that 

m l+ = p i + a l 

where p l E Z and each a 1 is either or ^ . 

We now turn to the selfdual Lagrangian. We define a six-dimensional vielbein 
e A = ej^dx M which we decompose into e A = (e*, e a ) where a = 1, ■ ■ ■ ,5. For 
the three-form field strength we have 

Hmnp — e^efjepHABc 

where we define 

Ba = e^dM 

and 

Habc = 3d[AB BC ] 

To see this one notices that the ordinary derivative can be replaced covariant 
derivatives in the three- form, and the vielbein is covariantly constant. Then we 
consider the following six-dimensional Lagrangian (A = 

L = ~ J d 5 xVGe a ^H aPl d t B Se - J d 5 xVGH a ^H af ^ 

As we showed above, the Dirac charge quantization for the selfdual field strength 
is given by 



. H = Z + a l 
27r J a 

over spatial three-cycles a. Moreover, the selfdual holonomies 

X t (t) = cxp^. B+ 

are periodic or antiperiodic according to 

X t (t + 2ir) = (-l^X^t) 

The bi correspond to the characteristics bi in the theta function. In two- 
dimensions the holonomies correspond to fermions via bosonization. 
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4 The D4 brane partition function 

If we choose the metric on the M5 brane worldvolume on the form 

ds 2 M5 = G^dx^dx" + R 2 {dx 5 + v^dx^) 2 
then the corresponding D4 brane action will be given by 

S = Sym + + S^i 

where 

Sym = ~ J d 5 x^F^F^ + ^ J d 5 xGe^ F^F KT v a 

s*. = ~f d 5 x^dd^' A d^' A 

and the coupling constant is 

g = Att 2 R 

4.1 Scalar field 

The scalar field action is given by 



^ J d 5 x\[^GG^d^'d v cj ) ' 



2ff 
where 

g 2 = 2ttR 

This action is obtained by dimensional reduction of (3.2) and by defining 

4>' = 2irR(f> 
We introduce a regulator r' such that 

<j)' ~ <j)' + 27rr' 

but of course this regulator is different from the M5 brane regulator r. These 
are related as 

r' = 2-wRr 

The quickest way to compute the zero mode contribution to the partition func- 
tion is by lending the result from the M5 brane. To this end we absorb the 
coupling by rescaling <j>' . After this, we have 

r > 

d> ~ d> + 2tt — 
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Then we can borrow the M5 brane result and we get the zero mode part of the 
Hamiltonian as 

H = m 



2Vol' {r'/g) 2 

where we use Vol' = J d 4 x^/g in place of Vol = j d 5 x\/G. These volume factors 
are related by 

Vol = 27ri?Vol' 

To compare with the M5 brane Hamiltonian, we substitute r' = 2irRr. Then 

s/=fi n 2 



H = 



2Vol'2vri? r 2 



which now agrees with the zero mode part of the M5 brane Hamiltonian. Con- 
sequently also Z zero ^i agrees with Z zero ^ of the M5 brane. 

4.2 Gauge field 

The momentum conjugate to Ai is 

Ei = -^R^ Fti + -^ 5etijklFjkVl 
We choose temporal gauge 

A t = 

We first show that we can express the conjugate momentum in a six-dimensional 
form as 



l 

2~ir 

To see this, we first note that 



Then using sclfduality, we have 



1 ^..w. 1 

H 6D - ■ 

and then 



where we define 



H — F 

ZTT 
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and the identity follows. 

We next comment on the integer quantization of the momentum which fol- 
lows by the fact that it is conjugate to 27r-periodic holonomics. For YM we then 
have 



/ dx 1 A 1 ,E 1 
Jo 



= 2ni 



and for the six-dimensional theory we have 

r-2iz r 2ir 



/ dx 1 / 
Jo Jo 



dx b B 15 ,2i:E 
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where we write 2nE 15 due to integration over x 5 as necessary to get S 4 quantities 
on the rhs in both cases. From these relations together with 27r-periodicity of 
holonomies, we conclude that 

E 1 = 27m 1 
2ttE 15 = 2ttV 5 

where n 1 and n 15 are integer quantized. By identifying these integers as n % — n %b 
for i = 1,2,3,4, we conclude that 

2ttE 15 = irE 1 

and thus we should expect the conjugate momentum of our 'would be' six- 
dimensional theory, should be given by 



E r ' 



1 

47T 



I ~ Tjtmn 
9 H 6D 



or in other words, 

The Hamiltonian we derive from the 5D YM is given by 
T~Lym = E l F t i — Cym 



The first term is 

For the second term we first notice that 



and furthermore 
1 



j5ti : 



15ti 
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Thus 

T-Lym = V~g (^H^H 5i j - -HfjjjH 5t ij 

The six-dimensional Hamiltonian is given by 

Hm5 = —q- J d b x\J —GH™p P H mnp 

but by using the selfduality constraint this Hamiltonian can also be expressed 
as 

Hm5 = — ^~ J d b x\J —GH^Htnp 

To get to the second line we have assumed that the fields are independent of the 
coordinate on the fiber, so that integration along the fiber just gives a factor of 
2ir. We also used selfduality again, now in the form of Hl%H U3 = -H^H 5ij . 
We now have 

Hm5 = H Y m 

under the assumption of fields being independent on the fiber coordinate. In 
particular then, the zero mode partition functions are identical. 

5 Oscillators 

5.1 Selfdual tensor field 

In the spirit that M5 brane theory is a higher dimensional analog of selfdual 
scalar field in two dimensions, we begin by computing the oscillator partition 
function for a two-dimensional selfdual scalar field in a way that is easily gen- 
eralized to a selfdual two-form gauge potential in six dimensions. 

5.1.1 Two-torus 

Let us consider a real scalar field on T 2 with metric 

ds 2 = j3dt 2 + G xx (dx - V x dt) 2 = G xx {dx + rdt){dx + fdt) 

where 

V G xx 

f = -v-i£L 

v G xx 
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The action is 



S = -\\ dtdx^g Mh r d M <f>d N cj> 

As the orthonormal basis on the base-manifold whose coordinate is x ~ x + 2tt 
we take ip n = ^e mx for n > 0. The complex conjugates are ip n = if- n . The 
quadratic equation of motion reads (for n > 0) 

Q (d t + V x d x f + G xx d^j e lEt+mx = 



and it has solutions 



K = rn 
E„ = rn 



In Minkowski signature £"+ > and E n < 0. The Hamiltonian is 



ra£Z + 

where 



The partition function becomes 

Zo. 

where 



1 



v(t) = e JJ (l 



n=l 



is the Dedekind eta function. 

We note that the partition function can be expressed as a determinant 



Vdet 7 A 



where in this determinant we shall put dt — im where m € Z due to our con- 
vention where the time coordinate interval over which we compute the partition 
function is [0, 27r]. The physical time interval is 27ry / j/?[. 
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5.1.2 Six-manifold 

We now proceed to generalize this to six dimensions. If we impose temporal 
and Lorentz gauge 

i t B = 

Sb = o 

with respect to six-dimensional metric, then the Maxwell equation of motion 
becomes 

A 6 B = 

where A 6 denotes the Laplacian on M 6 . The energies are obtained by solving 
the equation 

A 6 (e l£ °V Q ) = 

where <p a denote an orthonormal basis of two- forms on M 5 . Such a basis can 
be conveniently chosen such that 

A 5 ip a = X a ip a 
{<P a ,<Pp) = &i 

where the inner product is given by [fp a ,<fp) — J Mr tp a A *5<f/3 and A Q denote 
eigenvalues and bar denotes complex conjugation. 

Obviously the eigenvalues X a may be degenerate. What is less obvious is 
that the partition function can be complex-valued. To see this, let us assume a 
Cartesian product M 6 = T 2 x M 4 . In this case we get 

B = ^zVO*) 

and we wish to solve the equation of motion 

{/\ 2 4>)ip + <t>A A ip = o 

Let us assume that we solve this equation by requiring 

A 4 ip = 

Then dip — Q and we get 

dB = d(pA(f 

Requiring this to be selfdual means that either both ip and d(j> are selfdual or 
both antiselfdual. This shows that the partition function will now contain a 
factor 

Z sc(T,gij) = - b _- 

T)(t) + 7?(t) 
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where denote the number of selfdual and antisclfdual harmonics on M4 re- 
spectively, and t](t) is the contribution from one selfdual scalar field on T 2 . 
Only if b + — b~ = do we have a real-valued oscillator partition function. The 
oscillator mode contribution for a selfdual tensor gauge field is given by the holo- 
morphic factor rj ^b + ■ We do not know how this factorization extends beyond 
the zero modes on M 4 in this case. One way to compute the oscillator mode 
contribution to the partition function of a selfdual tensor gauge field could be 
to directly work with a selfdual action for example the one we wrote down in 
section 3.3. 



5.1.3 Six-torus 



Let us now instead turn to the case when M% is flat T 6 . Since this is T 2 x T 4 and 
b + (T A ) = b~{T A ) = 3 the oscillator partition function will be real. This means 
that to compute the oscillator mode partition function for a selfdual tensor 
gauge field on T 6 we can simply take the square root of the oscillator mode 
partition function of a non-sclfdual tensor gauge field on T 6 . The Laplacian is 



A fi 



,MNf) q 
) OmON 



and this gets split into 



Let us define 



which satisfy 



where 



- ^v m d t d m + a 5 



Jp 



_ e . Pm * dx m Adx n 



(2tt)1 



Armn _ \ rmn 
5Jp — *pjp 



PraPr, 



with the property that {fp Ln )* are linearly 
This can be achieved by restricting ourselves to a half- 



We wish the consider a basis 
independent of /J 1 ™, 
space p € . This half-space can be selected by first picking a co-dimension 
one hyperplane in R 5 which only intersects the origin but no other lattice points 
in Z 5 . Such a hyperplane may be defined by one normal vector which we may 
take for example as n — (l,V2,V3,V5,V7,VTl)- Then we may define the 
half-space as = {p e Z 5 |n • p > 0}. The energies are 



E* = -V m Pn 



± 



0P 
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Let us define a projector 
Then 

mm / tt \mn fPq 

Jp ~ \ lL PJpq Jp 

satisfy Lorentz gauge p-mfp 1 ™ — (we drop the tilde for notation convenience). 
Moreover 

(/ P ™",/f) = VGn mn ^"s M 

We also define sclfduality projectors 
and define 

9m n _ t Q \ mn fPQ 
Jp — \ D p)pq Jp 

which obey (again dropping the tilde) 

(/r\/f) = vcs mn ^s M 

We expand 

B(X) = ]T (vmn^P + b^pj^) f? "(f) + C.C. 
p£Z% 

and this will now satisfy the Maxwell equation of motion, be in Lorentz gauge 
and give a selfdual field strength. We see that there are three independent 
polarizations a mrii p for a given momentum p. Let us denote these independent 
ones as dp for i = 1,2, 3. 

It is a general result that the Hamiltonian of a quadratic Lagrangian is given 

by 



* = £ 



Ei 44+^1 -£7-[6'TM r +; 



1\ A ••+..■ 1 



p \ p p 2 I p \ p p 2 



where 
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Since the Hamiltonian shall be non-negative in Minkowski signature, we shall 
take E + to be non-negative, and E~ to be non-positive solutions to the quadratic 
equation of motion. The oscillator partition function now becomes 



v(g MN ) 3 ri(g MN ) 3 

where we define a generalized Dedekind eta function and its conjugate as 
V (g MN ) = e~ inJ: ^ + E * J] (l-e 2 ^) 



v(g MN ) = 




If we pick T 2 with modular parameter r embedded in T 6 then Z osc contains as a 
factor 1 3 . This is an important observation to show modular invariance 

of the full partition function on T 6 . 

5.2 Scalar fields 

For the five scalar fields we get the contribution 

1 

rj(g MN ) 5 ^ MW f 

where E^ 1 are computed from acting on zero forms e iEt <j>(x m ). For a flat 
T 6 we get that same eta functions as those for the sclfdual tensor field since for 
flat space we have the same energies. 

5.3 Fermions 

In order to preserve supersymmetry on T 6 we shall impose periodic boundary 
conditions on the fermions on all the 6 one-cycles of T 6 . For the spatial directions 
this amounts to integer momenta. To get periodic fermions in the time direction 
we must insert (— 1) F . Thus the fermionic partition function is 

ti((-l) F e 2mH ) = e - 8 -£^K-^~) J] (l-e 2 "^)* (l-e- 2 ^)' 

Now for this periodic boundary conditions there is a zero mode p — which 
kills the whole partition function so that 

Z = 

Obviously this partition function is modular invariant. We may also relax pe- 
riod boundary condition in time direction while preserving supersymmetry since 
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supersymmetry variations are at a fixed time and do not see such a boundary 
condition in time. In that case we get the partition function as 

tr(e 2 - ff ) = e-^E^W-**) TJ (l + e 2,riB f) 8 (l + e" 2 ^) 8 

but now we can only expect this to be modular invariant under modular trans- 
formations that act on T 5 C T 6 and leave the time direction unaffected. So we 
shall expect this partition function to be only SX(5,Z) invariant. 

6 Modular invariance of M5 brane on T 2 x M4 

So far we have been studying M5 brane on circle hbration over a five-manifold. 
If we continue the program of circle hbrations, the next step will be to consider 
a two-torus fibered over some four-manifold. Since the modular group of a two- 
torus is SL(2, Z) we can ask whether the M5 brane partition function is SL(2, Z) 
invariant. Such a strategy was used in [2] for the case of a flat T 6 to prove full 
SL(6, Z) modular invariance on T 6 by first proving SL(2, Z) modular invariance 
on a T 2 embedded in T 6 . But we may generalize. The most general geometry 
for which SX(2,Z) modular invariance can be studied is where we have two 
commuting Killing vectors corresponding to a two-torus T 2 in the six-manifold 
M 6 . If we take one circle direction of that T 2 to be associated with time, the 
natural choice of metric will be 

ds 2 = f3dt 2 + G mn (dx m -V m dt)(dx n ~V n dt) 

on which we make a subsequent decomposition of the same form, 

G mn dy m dy n = 7 (dy 5 ) 2 + 9lJ (dy l - U l dy 5 )(dy^ - V> dy 5 ) 

Thus, by substituting dy m = dx m - V m dt, the full M5 brane metric is 

ds 2 = f3dt 2 + j(dx - V 5 dt) 2 + g l3 {dx l - V l dt - U i dx)(dx j - V j dt - Wdx) 

The first two terms can be combined into the standard metric on a two-torus 

7 (da; + rdt)(dx + fdt) 

if we define 

r = -V^^l 

The metric is invariant under simultaneous exchange of coordinates on T 2 , 

t' = x 
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and the following change of parameters in the metric, 

V' 1 = U l 
U' 1 = -V 1 



t' = — 



T 

f = - 1 - 

T 

7' = TT7 



We will postpone a study of modular invariance on generic such fiber-bundles 
to future work. Here we will assume the six-manifold M 6 is on the form of a 
Cartesian product 

M 6 = T 2 x M 4 

This corresponds to putting V 1 = U l = above. The metric on M 6 is then 
where 

ds 2 M2 = 7 (dx + rdt) (dx + fdt) 
ds li 4 = gijdx'dx 3 

The Laplace operator becomes 

A 6 = A 2 + A 6 



6.1 The zero mode part 

In the Appendix B we obtain the period matrix for T 2 x M4 for the case that 
dimH 1 (M4) = 0. This period matrix has been previously obtained in [22]. We 
have the following results for the period matrix and its inverse, 

tij = Tl(Q _1 )/J + t 2 Gu 
(t- 1 )" = nQ 7J + t 2 Q ik Q jl G kl 

Here r is the period matrix on T 2 and Q IJ and G IJ is the intersection form 
and the metric associated with M4 as defined in the Appendix B. We define 10 



n = 
T2 = 

The partition function is 11 



t 2 



- e ft] (tij) 



10 We remind that our notation is r = — n — T2 and f = — n + r-2 in both Minkowski and 
Euclidean signatures. We then define t = — i = — 

11 For simplicity wc consider only zero characteristics. It is also true that this choice is the 
most modular invariant choice [20], [21] 
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Two ingredients are involved to see the modular property of this partition func- 
tion under S'-transformation. The first ingredient is Poisson resummation, 



E 



I y 



iirmi(r )mj 



The second ingredient is to make use the intersection form (whose entries are 
integers) to define dual integers 

m 1 = Q IJ mj 



which results in 



where we define 



m/(r 1 )mj = m I Tijm J 



tij = n(Q 1 )u + t 2 Gij 
To compute the determinant we define 

m = mifl 1 

and 

m = m±*m 

we then consider the following equality (noting that ** = 1 and defining the 
inner product as usual). Then 

mjZ IJ m.j = — (r(m + , m + ) + f(m~ , to - )) 

We can compute the determinant as a product of exponents. These exponents 
factorize into selfdual parts, so we can compute the determinant of each factor. 
One such factor is 

1 



JJ J dm + exp -t(to + , to + ) 



Vdct Z IJ A i 

-a 

The product runs over the selfdual harmonic two-forms, and b + is the number 
of such two-forms. 

No contribution relevant for S-duality comes from harmonic one-forms on M4 
because these do not give a dependence on r. They involve various combinations 
that contain dtAdx, but no single dx nor single dt, so there is no r dependence. 

We find that the zero mode partition function transforms like 

Zzeroi. 1 9ij) = V^" Z zero (T,gij) 
T 

A corresponding result was obtained in [22] for non-Abelian gauge group. How- 
ever in this reference it seems the second ingredient of using the intersection 
form Q IJ to define dual integer numbers is missing. 
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6.2 Oscillator mode part 

Oscillators contribute with a generalized eta function. Zero modes have already 
been analyzed, and the determinant of the six-dimensional Laplacian acting on 
two-forms, equals the generalized eta function up to a zero mode factor. 

We have learned how to extract Z osc from the determinant. Let us now 
consider the determinant that is relevant to this situation 

detA 6 = dct(A 2 + A 4 ) 

We will ignore the issue of gauge fixing and ghost determinants. Instead we 
will map this determinant directly to Z osc . Only massless modes from two- 
dimensional point of view can contribute an SL(2,Z) anomaly. So it is enough 
to consider zero modes of A4. These are the harmonic two-forms on M4. Thus 
the determinant we will be interested in reads 

(detA 2 ) b2 

From this result we can immediately conclude that the r dependence of the 
oscillator partition function is 



^osc (^"5 9i j ) 

and it transforms as 



1 



T](T) b+ r](T) 



b- 



_LY + ( _L 



^osc( ~ t 9ij) — ( — 7= ) ( ~~7E ) Z osc (t i gij) 



Z osc (T + l, gij ) = e^^-^Z^T,^) 

The total partition function is thus invariant under S'-transformation r — > — - 
and transforms at most by a phase under T-transformation r — > r + 1. The 
partition function is modular invariant whenever b+ = b-. This shows that 
the partition function is modular invariant on T 6 but not on T 2 x TN where 
b+ ^ 6_. (On TN we have b+ = 1 and = 0). 

For the five scalar fields we also find modular invariance on T 6 , despite the 
oscillator mode contribution by itself is not modular invariant. But we do have 
a zero mode contribution also for the non-compact scalar fields, as we showed 
in section 3.1. For the case that W = T 2 x M 4 (whereof T 6 is a special case) 
we find that we can express the zero mode factor as 

J_ 
1 

It transforms under S'-transformation into 

Z Z ero{ ; 9ij) — \^~\Z zero [T^ 
T 
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For a single scalar field the oscillator mode partition function transforms as 

-2-osc( i9ij) — 1 t-2 osc (t) 
t \t\ 

showing that Z zero Z osc is invariant under S'-transformation. The same holds 
true for T-transformation on T 6 . 

For the fermions on T 6 and if we assume antiperiodic boundary conditions 
in all directions, we find a zero mode that kills the whole partition function. 
Obviously is SX(6,Z) modular invariant. If we choose periodic boundary 
conditions on the circle in T 6 that we associate with time, then we shall only 
expect to find SX(5,Z) invariance. And indeed this amount of symmetry is 
manifest in our expression for the oscillator mode partition function, as was 
also noted in [2] in the context of tensor gauge field on T 6 . 

Thus the M5 brane partition function with zero characteristics on a flat T 6 is 
SL(Q, Z) modular invariant, and on T 2 x M4 it is SL(2, Z) modular invariant up 
to a phase. Under dimensional reduction to four dimensions we find a partition 
function which is a modular form [23]. It is natural that we get different modular 
properties of the partition functions in four and six dimensions since we truncate 
away all the KK modes in four dimensions. Nevertheless we do find a modular 
property in four dimensions. This experience could motivate us to ask if some 
modular property could also be found in five dimensions. 

The oscillator parts of both D4 and M5 are on the form of generalized 
Dcdckind eta functions. Let us consider a flat six-torus. Then the frequen- 
cies E nm that appear in the generalized Dedekind eta function are the positive 
roots to the equation of motion 

g MN n M n N = 

where we solve this equation for n t — E nm and pick the positive solutions (in 
Minkowski signature). For the D4 brane E ni are positive solutions to 

G^n^ = 

where nt = E ni . We use the index notation M — (u, 5) and \i = (t, i) for 
i = 1, • • • ,4. Since 

9 MN n M n N = & v (n M - t> M n 5 ) (n u - v v n 5 ) + ^n b 2 

we see that 

g MN n M n N - G^n^ 

only for vanishing KK momentum n 5 = 0. 

If we pick factors in with rii — and perform the product over all 

non- vanishing Kaluza-Klcin momenta n 5 = 1, 2, 3, • • • , then these give rise to a 
r-dependent factor 

1 

3 
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Here the powers 3 correspond to the six harmonics bij on T 4 , separated into 
sclfdual and anti-selfdual parts. These harmonics are responsible for the 3-fold 
degeneracy of E n5 . For the D4 brane we put n 5 = and this r-dependent factor 
does not arise in ZP,f. 



7 The M5/D4 partition function on T 6 

Multiplying together the various contributions, what have found on T 6 is the 
following M5 brane partition function 



where 



r M5 



'zero^ 1 osc 



r M5 



?M5 



and where p = (p m ) 
that 



e Q (-r) 
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l + e 



iVol 
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l + e 



-2mE-, 



1 — e p / \1 — e 

{PiiPb) f° r i = 1, — ,4. For the D4 brane we have found 



-2ixiE s 



rDA 



rDi 



-zM5 

zero 
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l + e 



-2niE~ 



1-e 



2-kiEZ 



1-e 



-2niE„ 



What is missing so far from the D4 brane are the KK modes with p 5 ^ 0, to 
which we will turn our attention in the next section. Let us here just note that a 
particularly simple KK sector in the M5 brane oscillators is obtained by taking 
Pi = with p 5 ^ 0. We note that 



E 



Pi=0,P5 



= ±^Vg^\ P5 \-v 5 P5 



and so by defining 



we find that this sector gives the following contribution 



7M5 

osc,pi 



- - n 1 



P5 = l 



1 + q P5 



1 + qP* 



(7.1) 
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8 Small instantons and KK modes 



Up to now we have shown that the naive D4 brane partition function on T 5 does 
not match with that for the M5 brane on T 6 . The zero mode's part has the 
precise agreement while there is a clear mismatch in the oscillator part of the 
partition functions. If the proposed D4 / M5 on S 1 correspondence is correct, 
this implies that one is missing certain degrees of freedom from the D4 brane 
side. It is clear from the previous discussion so far that the missing part are all 
those spectra of KK modes along the circle direction S 1 . Here we would like to 
show that this KK part of the partition function is precisely generated by small 
instantons corresponding to DO branes of the type IIA string theory. 

Taking our S 1 as an M-theory circle, the M5 becomes D4 by the type IIA 
reduction and the KK circle momenta are corresponding to DO branes from the 
view point of the type IIA theory. If DO branes are away from the D4 to the five 
transverse directions, then their Hilbcrt space is not to do with that of the D4 
brane. When DO branes are located on top of the D4, they can be bound to the 
D4 brane forming a (threshold) bound state, which can be faithfully captured 
by the D4 brane worldvolume dynamics we are dealing with. This is one of 
the basic construct of the D4 / M5 on S 1 correspondence proposed in Refs. 
[11, 12]. These DO branes are captured by the well known instanton dynamics 
of D4 branes satisfying the sclfdual (or anti-sclfdual) equation 



where the hodge dual * 4 is taken over the four spatial direction of the world- 
volume directions of D4 branes. The instanton number is counted by an integer 

n 5 



For the SU(N) part of N D4 branes with N > 2, regular solutions of the 
above self dual equation can be found explicitly. It is well known, however, that 
for the case of U(l), the corresponding instanton solutions become singular 
classically. Hence one has to introduce some regularization in order to use 
the conventional techniques including the moduli space approximation. Here 
we shall introduce the noncommutativity parameters for the spatial part of 
the coordinates for the sake of the regularization and then, in the end, we 
take the commutative limit by sending the noncommutative parameters to zero. 
In this regularization, the instanton size squared turns out to be of order of 
the noncommutativity parameters. Since we are interested in the small size 
limit, the physics of global aspects decouples from the local dynamics and, 
for instance, the boundary condition on their wave function can be imposed 
separately afterwards. 

Hence by an appropriate coordinate transformation, we make the D4 brane 
worldvolume metric to the standard flat Minkowski form, 



F = (-)* 4 F 




ds\ = —dz$ + dzidzi 
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With these coordinates, the 6d metric including circle fibration now takes the 
form 

dsl = ds\ + R 2 (dx 5 + v^f 
Wc shall introduce the spatial noncommutativity 

where the noncommutativity parameters Oij can be fully parameterized by 

where 77^ and fjij a = 1,2,3 are the selfdual and anti-selfdual 't Hooft tensors 
respectively. 

We shall focus on the Maxwell part of the D4 brane action that is given by 

s = -J^J d * zF ^ F " + zh J d5ze " XSpp ^ Fxs ^ (8A) 

and we are interested in the instanton solutions satisfying 

F-ij — T^ijklF 

and their moduli space dynamics. The instanton solutions of the selfdual equa- 
tion and their modular space dynamics can be systematically studied by the 
so called Atiyah-Drinfcld-Hitchin-Manin (ADHM) method of the construction 
[24] , for which the noncommutative deformation can be incorporated in addition 
[25]. We shall not introduce all the details here but just necessary part for the 
present purpose. The ADHM equations for selfdual instantons reads 12 

[z, z ] ] + [w, w f ] + n ] = c 3 = C 
[z,w] + u = c' + < 2 

where X and W are complex n 5 x n 5 matrices and P and J are TV xn 5 complex 
matrices. As before TV is for the N parallel D4's and wc are here only concerned 
about the N = 1 case. We note the anti-selfdual part of the noncommutativity 
parameters enters for the ADHM equations for selfdual instantons. Since there 
are U{n§) gauge symmetry for the n$ instanton dynamics, one has to mode out 
the degrees of the above ADHM equations by an appropriate U (77,5) gauge fixing 
conditions. Thus the moduli space dimension as parameterized by the matrices 
is given by 4n| + An^N moded out by 3n 2 conditions imposed by the ADHM 
equations together with n\ gauge fixing conditions. Therefore the resulting 
dimension becomes An^N or 4n 5 for our interest of N = 1 case. The moduli 
space metric reads 

ds 2 = tr ( dP dl + dJdP + dZdZ^ + dWdW^ ) 

with an appropriate gauge fixing condition. 

12 The anti-selfdual instanton corresponds to replacing ( a by £ a in the ADHM equations. 
Therefore, to have ADHM constructions for both instantons and anti-instantons, we need to 
have both ( a and £ a non-vanishing. 
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8.1 One instanton dynamics 

From now on, we shall focus on U(l) case with N = 1, set £,1+1(2 = (1+1(2 =0 
and take ( > 0. Then for one instanton case with 715 = 1, the gauge fixed 
solution reads 

-Tl x 1 = \/C j -A x 1 = 

while Zi x i and Wi x i are not constrained at all. Thus we conclude that one 
instanton moduli space is given simply by flat R 4 with 

ds 2 n5=1 = \dZ\ 2 + \dW\ 2 = dXidXi 

where Xi is the position on R 4 . This describes a DO with a definite finite size 
freely moving along the worldvolume directions of the D4 brane. ( One can show 
that there is a finite binding energy between DO and DA due the nonvanishing 
noncommutativity parameter (.) 

For the details of its Hilbert space and moduli dynamics, one may be more 
explicit for this simplest case. Of course via the ADHM construction, one may 
find explicit nonsingular one instanton solution Ai(z) with A = [25, 26] but we 
do not need here its explicit form since the translational symmetry of the system 
will be enough to show some details as will be clear below. With the choice of 
Ac = 0, the configuration Ai(z — X) is explicitly describing the moduli space 
R 4 . Here Xi are the so-called collective coordinates for the moduli (solution) 
space interpreted as a position of DO along the worldvolume directions of the 
D4. In general the zero mode that is the variation of the solution tangent to 
the moduli space requires an extra gauge transformation 

SiAi = -—A, + —A,- 



dXj dzi 



where Xj will be chosen such that the Gauss law constraint -g^SjAi — as a 
gauge fixing condition. For the present one instanton case, the gauge condition 
is trivially solved with Xj = 0. Thus for the explicit moduli space dynamics, we 
insert the ansatz 

Ai(z-X(t)), A a = 

to the action (8.1) in order to obtain the low energy effective action for the 
one-instanton dynamics. This will be valid up to quadratic order of the velocity 
Xi. For the evaluation we further note 



1 



d 4 zF ij F ij = n 5 = 1 
Si 



16^ 2 J 13 13 
— I d 4 zF- -F- =^0 

167T 2 / Zr% rim ~ 4 



where for the latter we have used the translational symmetry of the one-instanton 
solution. The resulting effective Lagrangian for the one-instanton dynamics 
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reads 



For anti-instantons we instead find (with = — 1) 

K'sT 1 = ^ + n s 5 o - H M + «5 ^ 

The canonical momentum has an extra contribution from the first-order time 
derivative term, 

ri5 • 

Pi = + n 5 Vi 

H 

with upper sign for instanton and lower sign for anti-instanton respectively. The 
Hamiltonian becomes 

H = ±— - n 5 w ± — fa - n 5 Wi) (p* - n 5 v t ) 

Here is the mass of the nonrelativistic motion of an instanton and of an 
anti-instanton respectively. We note that the sign is precisely such that this 
mass is always positive. One then recognizes that this is the nonrelativistic 
version of the relativistic counterpart 

2 

-(po-n 5 v ) 2 + (pi-n 5 Vif + ^ - (8.2) 
in Minkowski signature if we make the following identifications 

H = -Po > 

for the instanton and the anti-instanton respectively. Here Pq denote the pos- 
itive and negative roots to the quadratic equation of motion (8.2) (for a suffi- 
ciently small vq). Since one has the 5d Poincare symmetry of D4 in the com- 
mutative limit, one may argue thatthe above should be the precise spectrum; 
Its 6d version takes the form 

g MN PMPN - 

with the instanton number n 5 is identified with the KK momentum p 5 along the 
circle direction. Thus we conclude that the required spectra for single KK mode 
are precisely reproduced from the single instanton and anti-instanton dynamics 
respectively. 

The supersymmetric extension of this analysis for the one-instanton case 
is rather straightforward. We shall describe simply the result here. The one- 
instanton is half BPS (preserving half of the 16 supersymmetries) and the 8 
fcrmionic zero modes form a multiplet consisting of 8 bosonic and 8 fermionic 
states. This agrees with the ground state degeneracy of one-DO and one-D4 
bound states. Among the 8 bosonic states, 5 correspond to the KK parts of 5 
scalar while the remaining 3 are the KK modes from the selfdual two form gauge 
field. The fermionic part are also matching precisely with the KK modes from 8 
fcrmionic degrees. Thus we conclude that the dynamics of one instanton sector 
is precisely matching with that of the one KK mode of the M-theory circle. 
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8.2 Multi instanton dynamics 



We now turn to the cases of higher instanton numbers. The case of two U(l) 
noncommutative instantons has been analyzed in [13] which leads to the metric 
on the 8 dimensional moduli space 

where the center of mass part is R 4 with metric 

ds c 2 om = dXidXi 

while the relative part of the metric is given by the Eguchi-Hanson metric [27] 

In this metric a a are the standard SU{2) left invariant one forms given by 

<7i = — sin ijjdO + cos ip sin 9dip 

02 = cos ipdO + sin ip sin Odip 

03 = dip + cos Odip 

and the angular variables are ranged over 

0<9 <ir, 0<ip<2n 1 < V < 2tt 

due to these angular ranges, the geometry involves S 3 /Z 2 whereas a full S 3 
requires the range < ip < 4ir. As expected, this metric is nonsingular at 
r = 0. In the commutative limit of ( — > 0, one may ignore any interactions 
between instantons completely leading to the metric for 

R 4 x R 4 /Z 2 



or 

T 4 x T 4 /Z 2 

including the global boundary conditions, where Z 2 is interpreted as the per- 
mutation symmetry of identical particles. Thus the Hilbert space for two KK 
modes is realized by the two instanton dynamics. 

Their quantum mechanical Hamiltonian is given by the Laplacian operators 
of the geometry acting on the wave functions with internal structure charac- 
terized by n-forms. It is well known that the Eguchi-Hanson metric allows a 
unique normalizable selfdual harmonic two-form state 

2r 3 , 1 

<x>2 = rdr A 03 H r ai A a 2 

(r 4 +4C 2 )i (r 4 +4( 2 )5 
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This is interpreted as a threshold bound state two U(l) instantons. As noticed 
in [13], this threshold bound state corresponds to the state of the charge two 
(n 5 = 2) KK mode. 

For the maximally supersymmetric case, the counting of relevant two-instanton 
states goes as follows. As explained each DO brane has 2 4 states, eight bosonic 
and eight fermionic. Now for two DO branes, considering them as identical par- 
ticles, the exchange symmetry has to be incorporated in this counting of internal 
states. There are | x 8 x 9 possible states with both DO branes in the bosonic 
states. There are also \ x 8 x 7 states with both DO branes in (different) fermionic 
states (due to the exclusion principle). The remaining possibilities include 8x8 
states with one in a bosonic state and one in a fermionic state. Hence the two 
(separate) DO branes involve in total 128 states. But as just described above, 
two DO branes can also form a threshold bound state and be bound to the D4 
brane, which is then identified as a single n 5 = 2 KK mode. This involves 16 
states as a single entity. Thus the total number of states with n 5 — 2 is counted 
as d 2 = 16 + 128 = 144. 

Threshold bound states for n 5 > 2 have not yet been constructed. However 
their existence was proven in [14]. For n 5 = 3 there is thus a threshold bound 
state which corresponds to a single instanton particle carrying instanton number 
n 5 = 3 and which has 16 internal states (eight bosonic plus eight fermionic). 
We can also have two separate instanton particles, one with instanton number 
«5 = 1 and the other being a treshold bound state with instanton number 
U5 = 2. Since these two instanton particles are distinct they contribute with 
16 x 16 = 256 internal states. Finally we can have three separate instantons each 
carrying instanton number = 1. As each of these instantons can be either 
bosonic or fermionic they add up to 120 + 288 + 224 + 56 = 688 internal states. 
(The four terms correspond to instanton types BBB, BBF, BFF, FFF where 
B and F refers to 8-bosonic and 8-fermionic states.) Thus for n$ = 3 we have 
in total d 3 = 16 + 256 + 688 = 960 states. In general we get the total number 
of degrees of freedom d ns at a given instanton number n 5 from the following 
generating partition function as 

n=0 n 5 =l V 7 

where the overall 2 8 is the counting of states for D4 brane ground states. This 
formula can be derived from the counting of BPS states in string theory and 
using some chains of U dualities [28], [14]. We have explicitly checked that the 
coefficient di , c? 2 and cfo are correctly generated by this generating function. 

The counting is precisely in parallel with the required KK states which is 
the missing part of M5 brane partition function in the naive D4 brane computa- 
tion without incorporating instanton contributions. We note that 2^ p . =Q as 
obtained in eq (7.1) contains as one factor the generating function of instantons 
(8.3). The second factor in eq (7.1) which involves a product over q shall be 
interpreted as the contribution from anti-instantons. 

Instantons are BPS configurations, which means that static instantons do 
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not interact among themselves. Static anti-instantons likewise do not interact 
among themselves. However an instanton interacts with an anti-instanton since 
such a configuration is not BPS. Also if we give some small momenta to instan- 
tons, they start to interact and feel the metric of the moduli space. However as 
the instanton and anti-instanton sizes become small in the commutative limit, 
the moduli space becomes flat and these become non-interacting particles. In 
the same fashion instanton and anti-instanton interactions disappear in this 
limit. Their contribution to the D4 brane partition function then factorizes. 
First from the instantons we have the factor 

where n, labels momenta of an instanton or a threshold-bound state of instan- 
tons which we call a KK particle with n§ = 1 or with some nonvanishing n$ 
respectively. Using the counting of degrees of freedom as obtained above up to 
instanton number n 5 = 3, we have the following contribution from KK particles 
with a specific momentum rij to the D4 brane partition function 

Z «f = 1 + 16 e 2mE ^ + 16 e 2wiEi ^ + 128 e 4 "^- 1 

+16e 2mE ^ + 256e 2 ™( £ "V +i ^) + 688e 67 "^ 
+ ... 

where refers to — p^ > where p^ are the two roots to the equation 

(8.2). Second from the anti-instantons we have the factor 

<ganti—inst <ganti—inst 

As we have seen, the anti-instanton is associated with E+. = — Pq > for 
negative. We then find that 

+ 16 e 2 ^,-3 +256e 27ri K-- 1+ <'- 2 ) +688e 6 ^t- 
+ ... 

We now claim that 715 7^ contributions to the M5 brane partition function 
contain generating functions for these instanton and anti-instanton threshold 
bound states. More precisely, we claim that 

e ™s.™5 \ 



zanti—inst 




n 5 — — 00 



^ _ e 27ri_E+ _„ 5 



1 + e "»'"5 
l _ ^2«i+~I7 
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It is rather easy to check explicitly that these generating functions reproduce 
the correct number of degrees of freedom for each threshold bound state up to 
total instanton number n 5 = 3. By noting the relation 



= -Ez 



it is easy to see that we have 



where the various factors on the right-hand side correspond to instanton num- 
bers n 5 = 0, n 5 > and n 5 < respectively. We may also phrase this relation 

as 



since the non-commutative D4 already has those instanton sectors in the theory 
so they shall not be supplemented. 

There is now little doubt that the M5 brane is really the same thing as 
(noncommutative) D4 in the above sense. In particular the M5 brane partition 
function encodes the number of internal degrees of freedom of each DO brane 
threshold bound state. 

One final note is the fact that the zero mode part of the partition function 
include also so called large instanton configurations which are satisfying the 
same (anti) sclfdual equation of instantons. However as we showed explicitly, 
these large instantons arc nothing to do with DO branes. Namely, without 
involving any DO branes, we have shown that the zero mode part of D4 and M5 
has already an agreement with each other. 

Since the essential properties of small instanton contribution we are using 
are only local ones, one expects that the above discussion can be extended to 
the case of general five manifold with circle fibration. But the relevant ADHM 
construction and the corresponding rcgularization is lacking currently. We shall 
leave this issue for future investigations. 

9 Singular fibration 

So far we have considered circle fibers with constant radius R. We may also 
consider situations where R depends on the D4 brane worldvolumc coordinate. 
At some points one may also allow R = in which case we have a singular 
fibration. From the M5 brane worldvolumc point of view such singular fibrations 
are smooth and pose no further problems in the computation of the partition 
function, but from the D4 brane point of view the computation of the partition 
function becomes much more difficult when R is not constant. Also we may 
need to add new degrees of freedom at the locus of the singularity R = 0. 
As a singular fibration we may consider the M5 brane worldvolume on the 
form W = TN x T 2 with TN being a Taub-NUT space that supports a single 




lim ZPfiT 5 ) 
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harmonic selfdual two- form Such a fibration has been considered also in 
[29], [15]. Then the zero mode part of the M5 brane partition function will 
involve 6(r) where r is the period matrix on T 2 . There is no fully modular 

invariant theta function except for 9 f (r) that vanishes 13 , so the M5 brane 

L 2 J 

partition function will depend on the choice of spin structure. As symplectic 
basis of harmonic three-forms on W we take 

a = il + A dx 
P = fl + Ady 

and the period matrix of W becomes the t parameter of T 2 . On the five- 
dimensional base-manifold M 3 x T 2 we have sYM theory with coupling constant 
g 2 <~ R. It appears that the zero mode contribution from sYM can not give us 
a t dependence of the partition function because the only harmonic two-form 
is the one on T 2 itself, while to have a r dependence we would need a harmonic 
two- form that has only one component on T 2 . Such a harmonic two- form is not 
normalizablc on R 3 x T 2 and must be excluded. Instead we have to add a chiral 
scalar action localized at the singularity {0} x T 2 of TN x T 2 . The chiral scalar 
of course gives us a partition function 0(r) on T 2 . 

Another way to see this is by studying the gauge anomaly cancelation. The 
graviphoton term 

SsYM = — / AAdAAw 



with 



w = —-^r€ijkX % dx3 A dx k 
2r 3 



has the anomalous gauge variation 

SS s ym = / d\AF [ w 



XF 
It 2 



under the variation 



SA = dX 

This gauge anomaly can be canceled by a gauged scalar field theory 

Swzw = ^ [ (|# + A| 2 +20F) 
supported on {0} x T 2 whose gauge variation is 



4tt J t , 



5 Swzw — ~— 

It 2 



3 That is not so if we couple M5 brane to a background C field though. 
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under 

5<t> = -X 
5A = dX 

Moreover, 2ir periodicity of the holonomy J A implies that <f> is also 2ir periodic 
in order to make dcf) + A a gauge invariant quantity. Now this together with 
the normalization we found for Swzw tells us that we have a coupling constant 
which corresponds to the free fermion radius. This action corresponds to Chern- 
Simons theory in three dimensions at level k = 1. Such a Chern-Simons theory 
may be derived from seven dimensions by expanding 

c = n+ AA 



We then get 



— [ CAdC = — 
4tt Jm.xw 47r 



f fl+ A n+ [ AAdA 
Jtn JRxT 2 



The selfdual harmonic two-form was found in [30], [31]. We will normalize it so 



that 0+ = j^uj where 



oj = — — <7i A cr 2 + t — —TT^dr A a 3 
r + 1 (r + iy 



using the notation and conventions of [30]. Then we have 

0+ = 1 

n+ a o+ = i 



I'- 



I: 



where the three-cycle c is spanning the r, ip plane where the coordinate range is 
4> G [0,47r]. We then find that A is a connection one- form whose holonomy is 
2tt periodic, induced from C, and we find that 



/ 



— I 4/- ,IA 

47T . 



with standard normalization, induced from Chern-Simons action for C. 

Another generalization we did not consider in this paper is to include six- 
manifolds which have no one-cycles at all. As we can see from our Appendix 
A, once we have a one-cycle, there is a natural choice of symplectic basis of 
three-forms and corresponding three-cycles. If we have no one-cycle in our six- 
manifold we may of course still find a symplectic basis though the method in 
Appendix A docs not apply to such cases. For example we may consider the case 
when the six- manifold is W = S 3 x S 3 . On S 3 we do not have a one-cycle even 
though it can be viewed as a Hopf bundle over a base manifold S 2 . Nevertheless 
we can define a symplectic basis for this situation by taking as basis three-forms 



46 



certain rescaled volume forms on each of the two S 3 respectively. One may also 
consider a situation where the two Hopf fibers make up a skew torus, in which 
case the period matrix t (which is just a complex number) can take any value in 
the upper half-plane. Also we have been ignorant about curvature corrections 
and essentially our presentation in the present paper is correct only for a flat 
T e . On curved space we need to add a curvature term for the scalar fields to 
maintain conformal invariance. Moreover superconformal invariance puts severe 
constraints on the possible six-manifolds one may consider [32]. However one 
may circumvent this constraint from superconformal invariance by considering 
a situation where one has a background flux on S 3 which spontaneously breaks 
conformal symmetry, while preserving maximal supersymmctry. Such a situa- 
tion was considered in [33] where it was shown that the zero mode parts of the 
M5 brane partition function on T 3 x S 3 matches with the corresponding zero 
mode part of the D4 brane partition function on T 3 x S 2 respectively. It would 
be interesting to extend this analysis to the oscillator modes. 
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A Period matrix on S 1 x M 5 

We assume a six-manifold on the form M 6 = S 1 x M 5 . On the space of harmonic 
two- forms f2 l on M 5 , we define a metric 



/ 



ft 1 A 



where * denotes the Hodge star on M 5 . We define a basis of dual harmonic 
three-forms 

fij = 27rCfjj * SI 3 
where C/y is the inverse of . Then we have a symplectic basis 

Ui = Oj 

= 0* A dt 

We assume j dt ~ 2tt and that J c . = <5* when integrated over dual two-cycle. 

The CKj and /3 l then have periods 27r when integrated over their dual three-cycles 
in M e . We also have the symplectic property 

a t A P = At: 2 81 

One may object that we should not need a metric to define a symplectic basis. 
As we will see in the next section, if M 6 = T 2 x M4 then this symplectic basis 
can be rewritten in terms of the intersection form on M4 and the metric does 
not enter the definition of the symplectic basis. 

We define the period matrix and its conjugate by requiring that 



'131 

U>i = Ui + fijfi 3 



are selfdual and antiselfdual respectively with respect to the six-dimensional 
Hodge star that we define with respect to the six-dimensional metric tensor 

MN = ( 0\ 

We will define this six-dimensional Hodge-star when acting on three-forms as 

*$dx M A dx N A dx p = \^e MNP M >N>P>dx M ' A dx N ' A dx p ' 

6 

This definition is related to the conventional Hodge-star as * 6 = conventional ■ 

Our Hodge-star depends holomorphically on f3 which we may promote into a 
holomorphic coordinate. Our Hodge star now squares according to 

*6*6 = 1 



48 



when acting on three-forms in six dimensions, and so we shall by selfdual- 
ity/antiselfduality mean that 

*qLO = LJ 
*qUJ = —UJ 

It turns out that the solution to these conditions can be expressed like 

T ij = ~(Tl)ij - (T 2 )ij 

where 

Q-i = (ri)ij/3 J + (T 2 )ij * 6 P° 

If we expand 
then 



_ X )ik Ak 
Yij — (C )ij 



From the symplectic properties, it follows that 

By brute force computation we get 

J * 6 /3* A ^ = -^=Q 11 



Here we define 

& = \ J d 5 xGe mn ^nl n ni q v r 

and we have the relation 

K, ij = 2ttC3 

however the latter form C lJ shows manifest symmetry in ij. Then we get the 
period matrix as 
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B Period matrix on T 2 x M 4 

For simplicity we assume that M4 has no one-cycles. Then the harmonic two- 
forms on M4 must be the same as the harmonic two-forms on M5 = S 1 x M4. 
Let us here denote these harmonic two-forms as 

& = \^ mn dx m A dx n = ^nfjdx 1 A dx j 

where x m = (x,x l ) for i — 1, 2, 3, 4 and x denotes the coordinate on the spatial 
S 1 in M5. We define the intersection form and the metric on H 2 (M4,Z) as 

Q IJ = [ rtAft 1 

J Ma 



G 



We then find that 



where 



1 = [ n 1 A* 4 n J 

J M A 

* 4 n I = X 1 .;^ 1 



X 1 ., = G IK {Q- l ) KJ 

By *4* 4 = 1 when acting on two-forms, we get 

G^iQ-^Kj = Q IK G KJ 

We define a symplectic basis on M 6 as 

a/ = (Q 1 )/j^ J A dx 
P 1 = Vi 1 A dt 

and indeed this is consistent with our choice of symplectic basis on S 1 x M 5 in 
our previous section. To see this we first notice that 

G IJ = 2nRG IJ 

and then 

2tt f * 5 n K a n L = g KI (Q^ 1 )u [ n J a n L a dx 

J M5 JM S 

Since f2 7 is an arbitrary element of H 2 (M4,Z) we conclude that 

2ng IK * 5 Vl K = (Q-^/jfi- 7 A dx 
We define the period matrix as 

tij = -(n)/j - {t 2 )ij 
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where 

ai = (ri) 7J ^ J + Y IjH p J 

We have 

xefl 1 = *4$1 / A *2dt 

and we have 

* 2 rfi = -^-(-dx + V x dt) 
We define the two-dimensional period matrix as 

t = — n - t 2 

where 

a = ti^ + t 2 * 2 /5 

and where 

P = dt 

a = dx 

From this definition we get 



T = ~V X + - _ 

We get the six-dimensional period matrix as 

tij = ti(<5 -1 )/,/ + T 2 G/J 

C Holomorphic factorization 

The Hamiltonian is 

H = — T2 In 2 + -^ m ) ~ T\nm 



1 / /TO \ 2 /TO \ 2 \ 



The partition function is 
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Following page 115 in [6] wc define 

q = e 2mT 
q = e- 2mf 

and compute 

^|eg](-r)| 2 = ^(^™V m2 + ^ (ll+ ^V (m+ ^ )2 ) \{i + {-i) n+m ) 

As the summand vanishes unless n + m = 2p is even, we can substitute 

m = 2p — n 

and we get a sum over n,p 
We substitute 

n = p — q 

and we get 

since in the second line we may break the sum over m into sum over m = 2p 
and a sum over m = 2p + 1. 
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